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CYBERNETIC  ASPECTS  OF  STATISTICS 
-  East  Germany  - 

^Fo  11  owing  is  a  trams  lat ion  of  an  article  by  Klaus-Jergen 
Richter  in  Statistische  Praxis  (Statistical  Practice), 

No.  1,  Berlin,  19  January  1963,  pages  15-19jt7 


The  number  of  fields  in  which  cybernetic  systems  are  discovered, 
is  constantly  expanding.  \Je  need  only  name,  for  example,  biology, 
control  technics  and  the  social  sciences  ^Note*  in  regard  to  the 
latter,  cf.  Thiel  n0n  liathematical-Cybernetic  Comprehension  of 
Economic  Principles'*  in  WirtschaftswlssenBchaft  (Economic  Science), 
1962,  No.  6,  page  8827.  111  the  final  analysis,  this  concerns  the 

recognition  of  systems  characterized  by  the  aspeots  of  system, 
control,  information  and  of  the  theory  of  probability  (llote*  cf. 

Klaus,  in  Foreword  to  Cybernetics  by  Poletajew,  Berlin  1962, 
page  XII).  Such  a  problem  formulation  certainly  does  not  exist  in 
the  search  for  the  cybernetic  asjJects  of  statistics.  Disregarding 
the  fact  that  statistics  plays  a  Significant  role  in  the  theoretical 
structure  of  cybernetics,  the  investigation  of  these  aspects  for 
statistics  is  contained  in  the  two  cjy,estions  on  the  role  of  statistics 
as  a  form  of  feedback  and  in  the  analogy  between  cybernetics  and 
statistical  categories  and  the  type  of  these  analogies,  a  .  »t 

Statistics  as  a  Form  of  Feedback 

Feedback  is  a  decisive  component  of  the  control  loop  which 
combines  the  aspects  of  system,  regulation,  information  and  of  the 
theory  of  probability* 
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The  system  aspect  of  the  control  loop  is  manifested  in  the  fact 
that  the  individual  components  of  control,  controlled  system, 
controlled  condition  and  feedback  form  a  cybernetic  system  in  vhioh 
information  is  processed.  The  regulatory  aspect  is  expressed  in 
the  fact  of  the  existence  of  a  control  and  of  a  controlled  parameter. 
The  information  aspect  is  manifested  in  the  form  of  feedback  through 
which  information  is  transmitted  to  the  control  on  the  status  of  the 
controlled  parameter.  The  theory  of  probability  is  that  aspect  of 
the  control  oixcuit  which  is  expressed '  in  the  choioe  of  action  by 
the  control  for  maintaining  the  controlled  parameter  at  a  given 
magnitude  or  value  in  spite  of  external  influences. 

Control  loops  of  this  type  exist  in  many  forms  in  teohnios  as 
well  as  in  natural  organisms..  Technical  devioes  can  exercise  the 
regulatory  function  quite  as  well  as  components  of  natural  organisms. 
There  are,  however,  also  control  loops  in  which  man  assvmes  the 
role  of  the  control.  &uch  a  control  loop  consists  for  instance  of 
a  motor  vehicle  and  its  operator...  This  system  poses  regulatory 
tasks  both  in  regard  to  the  direction  to  be  maintained  by  the 
vehicle  as  well  as  in  regard  to  the  speed  of  the  vehiole.  However, 
man  acts  as  control,  individually  and  collectively,  also  in  larger 
and  more  complicated  cybernetic  systems.  .. 

There  is  consequently  nothing  whioh  contradicts  the  interpreter 
tion  of  the  national  economy  as  a  very  complicated  cybernetic  system. 
Here  the  parameter  to  be  controlled  may  be  production.  On  the 
other  hand,  the  extent  of  investments,  accumulation  or  individual 
consumption  may  constitute  the  controlled  parameter.  The  oarreot 
magnitude  of  these  parameters  is  established  by  the  national-economy 
plans  in  a  socialist  planned  economy.  The  management  organs  of  the 
national  eoonomy,  the  control  of  the  system,  must  ascertain  that 
the  magnitude  of  the  controlled  parameter  prescribed  in  the  plan  is 
reached  and/or  maintained.  Their  regulatory  influence  on  the 
national  economy  is  subordinate  to  this  goal.  Correct  regulation, 
however,  also  requires  an  exact  knowledge  of  the  controlled 
parameter.  In  such  an  extraordinarily  complicated  cybernetic 
ayatem  like  the  national  eoonomy,  a  large  number  of  random  influences 
are  present  which  are  responsible  for  the  fact  that . the  regulatory 
measures  transmitted  by  the  control  produce  only  an  approximation 
(greater  or  lesser)  of  the  status  of  the  controlled  parameter 
desired  by  the  control.  Furthermore,  the  interference  in  the 
transmission  of  information  (the  so-called  noise)  and  the  inertia 
(greater  or  lesser)  with  which  the  controlled  parameter  reaots  to 
the  instructions  of  the  control,  reduce  the  immediate  and  direct 
effectiveness  of  the  instructions  of  the  control.  The  way  and 
manner  in  which  the  controlled  parameter  reacts  to  the  control 
determines  the  behavior  of  the  entire  system.  /See  Hotj7  (Cf. 
Illustrative  Control  Technology.  Berlin,  I960,  page  18). 
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Jxoxtft  In  technical  oontrols,  it  is  generally  relatively  easy 
to  da tormina  tha  transfer  funotiona  by  measurement .  In  the  field  of 
the  sooial  eoienoes,  this  oreates  a  rather  extensive  tasks  of  statistics ( 
not  always  easily  solved,  for  determining  the  transfer  funotions 
through  suitable  methods*  ?or  example,  let  us  assume  that  the  magnitude 
to  be  controlled  is  the  sale  of  oertaln  produots.  We  are  assuming  that 
sales  do  not  reach  the  desired  volume  so  that  the  oontrol  attempts  to 
influence  sales  through  lowering  of  prioe*  In  this  case,  the  oontrolled 
system  represents  the  prioe  level  which  is  varied  by  the  oontrol  at  the 
Instant  t0*  The  oontrolled  condition,  the  sale  of  the  respective 
pro duo t,  will  not  immediately  reach  the  eeles  volume  corresponding  to 
the  new  prioe  level  by  reason  of  the  different  oauees  mentioned  above 
but  assume  this  volume  only  at  the  instant  t^ .  Both  the  interval 
t1-tQ  as  well  os  the  form  of  variation  of  the  oontrolled  oondltlan  in 
this  interval  of  time  are  expressed  by  the  transfer  funotion*  Tbs 
two  following  curves  are  examples  of  transfer  funotions* 

oontrolled  oondltlon 


oontrolled 


condition  ' 
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It  becomes  dear  from  the  reasons  mentioned  that  there  are 
differences  a a  a  rule  between  the  actual  status  of  the  oontrolled 
parameter  and  that  desired  by  the  oontrol.  However,  effeotlve  perform* 
anoe  by  the  control  requires  that  it  be  continuously  informed  on  the 
status  of  the  controlled  parameter.  ’  In  national*eoonomio  oontrol  loops, 
statistics  can  eeame  the  extraordinarily  Important  funotion  of  fsedbaok, 
i»e*,  the  function  of  informing  the  oontrol  on  the  status  of  the 
controlled  parameter. 


Ab  explanation  by  a  simple  example,  let  us  assume  that  statistical 
data  covering  a  certain  period  or  time  are  available  on  the  sale  of 
oertaln  goods,  ■‘■hose  data  tend  to  show  that  the  sals  of  the  respsotlvs 
goods  is  subjeot  to  a  oertaln  annual  periodlolty  and  that  moreover 
oertaln  irregular  variations  occur.  The  periodic  oomponent  of  tbs  time 
sequence  shows  the  following  traoei 
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We  may  conclude  from  the  observed  irregular  variations  that  the 
effectively  determined  values  vary  on  the  average  by  e  maximum  of  1CJI 
above  and  below  the  norm*  is  shown  by  the  sketoh,  sale*  in  the  month 
of  August  represent  100j(  of  the  annual  average  but  rise  in  8ept saber, 
as  a  result  of  detailed  examination  of  the  average,  to  110  and  in 
October  to  11J8$* 

Let  us  assuae  further  that  prioea  were  lowered  in  August  to 
Lnorease  sales  of  the  respeotive  goods*  If  we  then  do  not  oolleot 
exaot  data  (in  the  form  of  the  transfer  function  mentioned  above)  on 
the  «»««*>  of  reaction  of  the  controlled  parameter  (salea)  to  the 
instructions  of  the  oontrol  (lowered  prioes),  we  may  then  be  oonfronted 
by  the  faot  that  information  on  the  status  of  the  oontrolled  parameter 
in  the  form  of  statistical  data  Is  obtained  too  early  and  that  there* 
fore  no  effeotive  information  oan  be  drawn  from  it*  From  the  multitude 
of  the  possible  transfer  functions  in  the  oase  deaorlbad,  vs  ahall 
merely  select  two* 

Sales  Sales 


In  oase  a)  no  appreciable  reaotion  of  the  oontrolled  parameter 
03 ours  in  the  first  two  months  after  the  prioe  ohenge*  Sales  inoreased 
only  to  a  minor  extent.  In  tho  third  and  fourth  month  also,  the 
loorease  of  sales  achieved  by  the  ohaage  of  prioe  reaches  barely  10^ 
of  the  starting  magnitude*  However,  sinoe  it  is  known,  on  the  basis 
of  earlier  investigations,  that  we  must  anticipate  a  maximum  average 
variation  of  1C£>  from  the  salee  volume  determined,  the  variation  of 
sales  as  oonaequenoe  of  lover  prioe  ooourrlng  during  the  first  four 
months  takas  place  within  the  limits  determined  by  the  irregular  ( or 
random)  variations*  A  variation  within  those  limits  may  be  the 
oonaequenoe  of  the  prioe  ohange  but  may  also  os  the  result  only  of 
the  random  variations*  Because  an  exact  a operation  oan  in  general  be 
effected  only  with  great  difficulty,  there  is  no  point  in  attempting 
to  procure  information  with  the  add  of  (statistical)  feedbaok  during 
the  first  four  months  after  the  lowering  of  prioes. 

In  oase  b),  the  transfer  function  shows  an  entirely  different 
trace*  Here  tho  deoltive  changes  of  the  oontrolled  parameter  ooour 
immediately  after  the  oontrol  action  (after  the  lowering  of  prioes)* 
lisoaua#  the  variations  of  atlas  to  bs  anticipated  already  la  the  first 
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■oaths  after  oontrol*  11*  abort  the  liolt  applicable  to  raado* 
variations,  tbexo  also  exists  tha  possibility  of  aeaauring  tha 
variation  of  tha  oontrolled  paraaatar  aa  a  ooaaeqaaaoe  of  ooatrel 
aotlon  and  to  traaaalt  tha  raapaotira  Infomatloa  to  tha  oontral* 
fhaaa  considerations  oan  ba  generalised  by  aaana  of  tha  following 
akatohi 


?or  tha  saka  of  slapll  .  a  liaaar  traaafar  fnnotlon  was  asaoned* 
Bovevar,  it  la  now  poaaibla  to  latrodaoa  a  nagnltude 


V  -  Aj  -  Bj  .  ,/ 

CD 

H  -  V- 1 

and/or 

(i») 

▼  ■  A  Rj 

A 

Of  oouraa,  thara  la  always  valid  hara 

1 

(2) 

*1" 

• 

af 

1 

-a 

1 

V* 

I 

1 

•a 

v 


Beoanee  tj  symbolizes  a  latar  point  in  tiaa  In  relation  to  tj.it  Rj  and 
Bj_i  Indloata  tha  magnitude  of  tha  oontrollad  paraaatar  R  at  tha  points 
in  tima  tj  and  tj.i •  and  tha  ■sgoltude  r  indloataa  tha  rlea  of  tha 

traaafar  function*  In  our  aka t oh,  r  la  oonataat*  However,  nothing  la 
ohangad  In  this  indication  of  magnitude  if  aa  adnlt  that  v  ltaalf 
rarlaa*  This  oooora  in  tha  non-linear  transfer  functions  vhloh  oast 
ba  axpaotad  la  gaaoral*  from  aquation  1,  there  follows 
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(3) 
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In  relation  3 »  tj.i  signifies  either  the  instant  of  oontrol  notion 
or  that  of  tho  last  measurement  of  tbo  controlled  parameter,  t^  further 

represents  the  next  measuring  instant  and  r  the  rise  of  the  transfer 
function*  The  relation  also  oontains  the  magnitude  A  V  l.e.,  the 

ohenge  of  the  controlled  parameter  in  the  transfer  from  instant  tj.i 
to  Instant  tj« 

There  now  exists  the  possibility  of  determining,  vhan  the  minimum 
neoessary  magnitude  of  the  change  of  R  ( l.e.  £  Rj)  and  the  starting 

instant  tj.^  is  given,  the  instant  tj  at  vhioh  new  information  on  tha 

controlled  parameter  in  the  eense  of  the  given  formulation  la  of  tha 
aarliest  uaefulnaea*  further  slmpllfloation  ia  poaalble  by  sotting 
tj.i  •  Oi  then 

t  *  1  A  E  (4) 

v 

expresses  the  interval  of  time  in  which,  starting  from  any  given  instant, 
a  new  (or  the  first)  measurement  and  consequent  information  is  pertinent* 
This  simplification  is  possible.,  however,  only  with  such  transfer  functions 
or  function  components  whioh  are  linear  or  nan  be  regarded  as  linear  with 
adequate  aoouraey  so  that  oonatant  values  of  rise  v  exist*  The  relation 
4  oan  be  very  simply  represented  graphically* 


Far  non-linear  transition  functions ,  we  most  turn  baok  to  relation  3* 
Hare  ve  know  that  v  is  then  no  longer  oonatant  but  itself  dependent  on  t. 
The  investigations  oonnseted  with  this  question  are  regarded  by  us  as 
neoeasary  and  useful* 


#’ 
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The  above  considerations  were  directed  to  thp  question  when 
statistical  information  on  the  controlled  parameter  is, of  use  in 
relation  to  the  given  transfer  fUnctionl  However,  it  is  also 
possible  to  arrive  at  ponolttsions  on  the  farm  of  procuring  statistics 
to  be  selected,  with  the  aid  of  the  transition  function*  As 
comparator  for  our  deois'ion,  we  utilize  here  the  expenditure  of  time 
required  for  the  procurement,  processing  and  transmission  of  a 
statistical  element*  For  the  process  "j,"  this  expenditure  amounts 
to  j  per  element*  The  total  expenditure  (of  time)  therefore 

amounts  with  the  statistical  treatment  of  n  elements  with  the 
prooess  "J"* 


Tj  “  n  *  (5> 

However,  it  is  obvious  that  the  magnitude  T^  must  be  smaller 
than  the  interval  A  tj  between  the  measurements  of  j-1  and  j 
(statistical  survey),  i*e»,  there  is  valid 

*)  <  ah  (6) 

In  the  opposite  case,  the  resultsof  the  measurement  of  j-1  are  not 
yet  available  at  the  instant  of  the  measurement  of  j*  This  means 
that  the  statistical  information  and  its  feedback  produced  by  them 
lose  their  meaning  for  the  activity  of  the  control* 


If  we  assume  further  that  a  certain  amount  of  time  is  necessary 
for  the  control  to  arrive  at  decisions  on  the  basis  of  the  information 
transmitted,  i*e*,  to  react  to  the  feedbaek,  then  relation  6 
becomes 


Tj  +  *r  <  (7) 

in  which  t ^  represents  the  reaction  time  of  the  control  in  regard 
to  the  information  obtained  through  feedback  (Notes  The  magnitude 
tr  is  assumed  as  independent  from  the  prooess  of  survey*  It  is 

possible,  however,  that  it  is  influenced  by  the  type  of  the 
oontrolled  magnitude)* 


Because  tj  contains  the  nimber  of  elements  n  which  can  be 


predetermined  because  the  spot-check  error  d  (in  the  determination 

of  which  n  enters)  must  be  smaller  than  the  difference  R  of 

J 

ths  controlled  condition  (Hotel  Through  the  assumption  of  the 
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difference  Zi  Rj  which  must  be  determined  for  reasons  of  the  control 

action,  the  extent  of  the  statistical  survey  is  obviously  interfered 
witji*  This  extent  n  must  be  determined  so  that  the^  spot-check  error 
linked  to  it  is  always  smaller,  when  taking  into^  account  the  other 
magnitudes  influencing  this  error,  than  the  smallest  practically 
usable  value  of^Rj,  indications  for  the  magnitudl^'^^  can  be 


obtained  from  relation  7  and,  with  their  help,  the '  respective 
method  can  be  selected.  However,  we  should  stress  that  these 
considerations  are  primarily  theoretical  because  the  required  , 
standard  time  values  y  for  the  individual  statistical  methods  !  are 


not  yet  available  and  are  not  simple  to  determine.  This  is  true, 
however,  also  for  the  transfer  functions  listed  above.  In  spite  of 
this,  we  believe  theoretical  investigations  of  this  kind  to  be 
necessary  in  order  to  investigate  the  relations  existing  between 
cybernetics  and  statistics. 


In  regard  to  this  problem,  complex,  let  us  mention  in  conclusion 
that  relation  7  can  be  further  narrowed  down  by  a  condition  which 
is  related  to  the  survey  costs.  It  may  be  required  not  only  that 
relation  7  is  not  exceeded  but  that  simultaneously  the  costs 
connected  with  the  survey 


K  -  n  •  kj  — )  IljLn inrun  (fl) 

assume  a  minimum  value.  Here  K  -  total  costs;  n  -  lumber  of 
surveyed  elements;  kj  -  survey  costs  per  element  when  utilising 

method  "j", 

Equation  8  is  a  restricting  condition  to  relation  7*  It  has 
been  indicated  what  considerations  arise  from  the  possibility  of 
interpreting  statistics  in  the  system  of  the  socialistic  national 
economy  as  a  form  of  feedback  which  represents  an  integral  component 
of  the  cybernetic  system  "national  economy,"  The  briefly  sketched 
considerations  may  deserve  to  be  pursued  further.  They  illuminate 
the  problem,  frequently  disucssed  in  the  pest,  of  the  interrelation 
between  planning  and  statistics  from  the  viewpoint  of  cybernetic 
concepts.  Planning  and  statistics  are  consequently  two  components 
of  a  system 


The  distinction  of  information-processing,  established  by 
Potthoff,  into  ex-post-facto  and  ante -facto  processing  cannot  be 
directly  accepted  on  the  basis  of  these  considerations,  at  least 
in  regard  to  planning  and  statistics  (Notes  Cf#  Potthoff  "Thoughts 
on  Information  Processing"  in  l/irtschaftawissenschaft.  1962,  No#  6, 
page  921  )•  Potthoff  lists  statistics  as  an  example  of  ex-post- 
facto  information-processing  and  planning  as  example  of  ante-facto 
processing.  For  ex-post-facto  processing,  he  considers  slow- 
working  data-processing  methods  as  adequate  but  feels  that  ante- 
facto  processing  requires  rapidly  operating  devices  (e#g# 
electronic  computers) ,  Actually,  statistics  has  the  character 
both  of  ante-facto  as  well  as  of  ex-post-facto  processing  of 
information#  In  the  form  of  feedback  in  the  national  economy, 
this  double  character  of  information-processing  manifests  itself 
clearly  because  information  furnished  by  feedback  is  needed  for 
renewed  planning#  In  this  regard,  statistics  is  a  component  of  a 
control  loop,  quite  independently  from  the  fact  whether  its 
information  is  to  be  furnished  over  longer  or  shorter  intervals  of 
time#  Simultaneously,  statistics  also  has  the  nature  of  ex-post- 
facto  information  processing  and  therefore  of  a  chain  of  information# 
However,  the  question  whether  slow  or  rapidly  operating  data- 
processing  installations  are  required,  does  not  depend  primarily  on 
the  distinction  between  ante-facto  and  ex-post-facto  data-processing, 
especially  since  this  distinction  is  not  always  easy  to  make  in 
statistics#  Statistics  are  perfectly  able  to  operate  with  slowly 
working  installations  (e#g#  punch-card  systems)  when  the  changes 
in  the  system  itself  take  place  slowly  and  the  minimum  magnitude 
of  the  changes  of  the  controlled  conditionally  becomes  adjusted 

only  very  slowly#  At  the  same  time,  it  maintained  that  the 
required  calculating  operations  can  be  effected  by  punch-card 
systems#  Although  this  specifically  concerns  work  which  has  the 
nature  of  ante-facto  information-processing,  the  utilization  of 
expensive  and  quickly  operating  electronic  devices  for  data- 
processing  would  often  be  uneconomical  in  these  cases# 


9 


Are  There  Analogies  Between  Statistic 


As  in  the  discussion  of  the  question  on  the  role  of  statistics 
as  a  form  of  feedback,  the  following  remarks  will  be  able  to  only 
touch  on  the  question#  For  one  thing,  there  do  not  as  yet  exist 
sufficient  investigations  of  this  problem  complex  and  it  will  also 
require  collective  efforts  In  order  to  arrive  at  further  results. 
The  analog?  between  statistical  and  cybernetic  categories  refers 
primarily,  as  far  as  we  are  now  able  to  deteraine,  to  relations 
between  the  theory  of  information  (as  a  component  of  cybernetics) 
and  statistics#  Adam  (Note*  Cf#  Adam,  "The  llaximum  Determination 
Scale  in  the  Case  of  Relations  Between  Qualitative  Characteristics" 
in  f-he  Utilization  of  Matrix  Calculation  to  Economical  aril 
Statistical  Problems.  Wuerzburg  1959 »  page  210)  has  published 
several  communications  on  this  and  has  treated  in  particular  tUe 
relation  between  entropy  and  scatter  (standard  deviation)  and 
questions  of  dependency  measurement  by  utilizing  considerations 
from  the  theory  of  information#  The  opinion  expressed  by  Adam 
that  statistics  tends  to  a  general  scienoe  of  information  (Notei 
Cf.  Adam,  "Entropy  and  Scatter",  in  Metrics  1958*1999,  page  99) 
merits  serious  examination#  It  wCuld  seem  necessary  to  undertake 
investigations  in  the  field  of  theoretical  statistics  in  the  future 
also  from  the  viewpoint  of  the  cybernetic  aspects  of  statistics# 
This  will  very  likely  produce  both  theoretical  as  well  as  practical 
benefit# 

\  * 

The  following  will  attempt  to  clarify  the  question  here 
investigated  through  the  example  of  a  comparison  between  the 
cybernetic  category  .of  being  organized  and  the  statistical  concept 
of  correlation  (the  remarks  on  theory  of  information  refer  to 
Poletajew,  Ibid#,  page  89)# 

The  entropy  of  the  number  of  states  of  the  element  Xj  of 
a  system  is  known  to  be 

VV  “  “  ^  pik  *  loe  pit  (9) 

in  which  n  possible  states  of  the  element  X^  (k  ■  1,  2,  ••••  n) 
are  assumed.  P..  is  the  probability  that  the  element  X  will  be 

specifically  in  the  state  k#  It  is  further  assumed  that  the 
system  consists  of  the  two  elements  X-j  and  X2#  If  these  elements 
are  independent  of  each  other,  the  total  entropy  of  the  system  is 


-  H(xi)  +  ^x2) 
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i.e.,  it  is  equal  to  the  sum  of  the  individual  entropies.  In  this 
ease,  we  speak  of  a  maximum  non-organ ized  system.  If  the  maximum 
non-organization  is  eliminated  and  connections  and/or  relations 
have  been  oreated  between  the  elements  and  X2  In  the  system^  then 

the  total  entropy  of  the  more  br  less  organized  system  ^(X.j/Xg)  is 

smaller  than  the  maximum  entropy  ^  Vrhioh:  exists  only  when  nan- 
organized*  There  is  then  valid 

H1(X1X2)  -  HCX^  +  HUg/^)  £  HCx^  +  H(X2)  (11) 

-  II(X2)  +  H^/Xg)  £  HU.,)  +  HCX^  (12) 

Here  HCX^^Cg)  and  ll(X2/X^)  represent  conditional  entropies,  i.e. f 
in  the  first  case,  in  regard  to  the  selection  of  if  is  known 

and,  in  the  second,  in  regard  to  the  selection  of  if  X^  is  known. 

Since  we  proceeded  from  the  assumption  that  relations  exist  between 
two  elements  of  the  system  and  that  they  are  therefore  not 
independent  of  each  other,  the  uncertainty  in  regard  to  the 
seleotion  of  one  element  must  decrease  if  the  other  element  related 
to  it  is  already  known  (Notes  A  very  simple  example  for  this  are 
piece-work  wages  in  which  the  wages  depend  on  output.  The 
uncertainty  in  regard  to  the  selection  of  an  employee  with  a  certain 
wage  is  appreciably  reduced  by  knowledge  of  his  output.  (This 
also  points  to  relations  between  the  ooncept  of  entropy  and  the 
problem  of  seleotion  of  the  random-sample  method)  )•  It  follows 
from  this  that 


HU.,/^)  ^  Htxp 

(13a) 

HU^)  <.  H(X2) 

(13b) 

This  proves  the  accuracy  of  equations  11  and  12#  As  a 
quantitative  measure  of  the  stage  of  organization  reached  between 
X,j  and  %2*  the  difference  between  maximum  entropy  H#  and  entropy 

(reduced  by  organization)  can  be  used  in  the  form  of 


6  H  -  H0  -  Hl 

(14) 

and/or 

A  H  -  HUp  -  HU^) 

(15a) 

and 

£>  H  -  H(X  )  -  H(X  A  ) 

(t5b) 

-  11  - 

This  magnitude  is  equal  to  zero  when  no  degree  of  organization  exists 
because  then  the  condition  is  equal  to  the  non-conditional  entropy 
and  the  knowledge  of  the  ohe. element  doee  not  reduce  the  entropy 
existing  in  regard  to  the  seleotion  of  the  other*  Both  elemente 
are  then  not  interrelated*  In  greater  or  leaser  organization  of 
the  system  *  & H  is  not  equal  to  zefo.  It  Would  seem  pertinent  to 
express  the  difference  £  H  relatively)  For  equation  15a,  we  then 
bbtaln 


ah  -  i  -  h(Xi/x2)  (16) 

n(x1) 

Since  conditional  and  non-conditional  entropy  conoord  in  the 
complete  absence  of  organization,  we  have 

AH,  •  0 

On  the  other  hand,  the  conditional  entropy  HCx^/Xg)  cannot  become 

less  than  zero*  If  a.  complete,  i*e»,  functional)  interrelation 
exists  between  the  two  elements  so  that  knowledge  of  X2  completely 
eliminates  the  uncertainty  existing  in  regard  to  the  seleotion  of 
X.|,  we  then  have 

AH,  -  1 

Accordingly,  we  can  then  delimit  the  relative  entropy  difference 
in  the  form 

0  £  4H*  1  (17) 

and  now  are  confronted  by  by  a  magnitude  which  corresponds  to 
the  scale  of  oertainty  (or  square  of  the  correlation  ooeffioient 
D  -  r2)  familiar  in  statistics*  For  B,  there  is  also  valid 

0  i  B  £  1  (10) 

in  which  the  case  "zero"  corresponds  to  the  state  of  complete 
independence  and  the  oase  "one"  corresponds  to  the  functional 
dependence  between  the  two  statistical  measurement  series. 

The  cases  of  dependence  between  two  statistical  series  of 
oharaoteristios  to  be  treated  by  the  theory  of  oorrelation  now 


And/ of 


-  HU,)  -  HU^) 


rowoal  thsnaslYoa  to  bo  a  spsolal  ooso  of  tbo  aoro  gonoral  oybomotlo 
oonospt  of  organization*  This  foot  also  btooaoo  oloor  vhon  vo  rsgard 
ooob  of  tbo  tvo  oloaoato  boro  nontlonod  oo  o  nunsrioal  intorrol  on  o 
straight  line  with  a  froquoney  dlotribution  givsn  shows  tbo  lottor  oa 
is  oaotOBoxy  In  oorrolation  ooloulotion*  tbo  following  okotoboo  oro 
tboroforo  oloo  oaaplotoly  idontlool  with  tbooo  f anil  lor  from  oorro  lo¬ 
tion  ooloulotion  ( Ho  to  i  Of*  Folotojovy  Ibid**  pogo  90)* 

iToquonoy  Dlotribution  of  tbo  Stotoo  of  Tvo  Slononts  X|  and 
o)  Undor  oonploto  aboonoo  of  orgoniootlon  (4  ■  Of  B  »  0) 


b)  Vhon  orgonisod  difforont  from  soro  1|  04B<1) 


0)  Undor  asadaun  orgoniaotion  (4Hy  -  1j  B  •  1) 


lo  diaouoo  in  dotoil  tbo  wariouo  oonsoquencoo  of  tbo  analogy  Just 
dononstratod  botwoon  aoalo  of  orgoniaotion  and  soalo  of  oortalnty,  would 
oxoood  tbo  aoopo  of  thla  artlelo*  Vo  may  bo  auro,  hovorar,  that  tbo 
utillaatlon  of  oybernotio  oonoopto  ia  able  to  oontrlbuto  to  tbo  olarifi- 
oation  and  undoratanding  of  statistical  oatogorios*  Undoubtodly,  otbors 
'  feosidoo  tbo  analoglos  boro  giwon  will  bo  found*  Hovovor,  that  utilisa¬ 
tion  of  oybornotios  In  st&tiatios  will  produoo  not  only  thoorotloal  but 
also  praotioal  bans fit  for  otatlotloal  work*  was  to  bo  doaonotratod  by 
noons  of  tbs  ron&rks  mods  in  tho  sootion  on  statlotlos  as  a  form  of 
foodbaok* 

(Tbo  obaoarwationa  oontalnod  in  this  artlols  wars  dslivorod  as  a 
lsoturs  at  tbo  Karl  Hass  Instltuta  of  Xoonoado  Soisnoos  in  Sofia  on 
15  Hevoabor  1962)* 
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